Gaze-tracking-based audio-visual correlation analysis employing quality of experience methodology

نویسندگان

  • Bartosz Kunka
  • Bozena Kostek
  • Maciej Kulesza
  • Piotr Szczuko
  • Andrzej Czyzewski
چکیده

This paper investigates a new approach to audio-visual correlation assessment based on the gaze-tracking system developed at the Multimedia Systems Department (MSD) of Gdansk University of Technology (GUT). The gaze-tracking methodology, having roots in Human-Computer Interaction borrows the relevance feedback through gaze-tracking and applies it to the new area of interests, which is Quality of Experience (QoE). Results of subjective tests carried out at the MSD showed a strong dependency between video presented in the screen and the perceived audio. It has also been shown that the application of gaze-tracking to the audio-visual correlation analysis allows for the objectivization of results obtained in subjective tests. Therefore this research study concentrates on the possibility to apply this methodology to the area of Quality of Experience.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Exploiting Audio-Visual Correlation by Means of Gaze Tracking

This paper presents a novel means for increasing audio-visual correlation analysis reliability. This is done based on gaze tracking technology engineered at the Multimedia Systems Department of the Gdansk University of Technology, Poland. In the paper, the past history and current research in the area of audio-visual perception analysis are shortly reviewed. Then the methodology employing gaze ...

متن کامل

What Are You Looking at? Improving Visual Gaze Estimation by Saliency

In this paper we present a novel mechanism to obtain enhanced gaze estimation for subjects looking at a scene or an image. The system makes use of prior knowledge about the scene (e.g. an image on a computer screen), to define a probability map of the scene the subject is gazing at, in order to find the most probable location. The proposed system helps in correcting the fixations which are erro...

متن کامل

Ph . D . in Electronics , Computer Science and Electrical Engineering

Scientific activity 1. Multimedia (video) Quality of Experience evaluation The first topic I worked on is the multimedia user Quality of Experience evaluation. I created a new video metric based on Eye-Tracking data to measure the perceived Quality of Experience of users subject to different quality level video stimuli. My proposal is based on my graduation thesis that proved how, if the databa...

متن کامل

Subjective evaluation of two stereoscopic imaging systems exploiting visual attention to improve 3D quality of experience

Crosstalk and vergence-accommodation rivalry negatively impact the quality of experience (QoE) provided by stereoscopic displays. However, exploiting visual attention and adapting the 3D rendering process on the fly can reduce these drawbacks. In this paper, we propose and evaluate two different approaches that exploit visual attention to improve 3D QoE on stereoscopic displays: an offline syst...

متن کامل

Does pedestrian useful visual field change at night?

This paper reports an investigation into the shape and size of the useful visual field over which pedestrian visual gaze tends to fall during day and night and discusses the factors affecting useful visual field and the function of peripheral vision. A previous study by authors explored what people look at at night in the streets employing an eye tracking methodology. This study is secondary an...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Intelligent Decision Technologies

دوره 4  شماره 

صفحات  -

تاریخ انتشار 2010